#offline inference

DeepSeek researchers released nano-vLLM, a compact and efficient Python implementation of the vLLM engine that balances simplicity with performance for LLM inference.